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|. INTRODUCTION 


| The motivation for this project stems from my belief that a 
computer question-answering system could be built that depends 
solely on a keyword search scheme for understanding questions. 
Further-- that it would operate within satisfactory limits so 
+hat it would actually be useful. It was my intention to pur 
posefully use as little syntactic or structural information as 
possible to find out just how much could be done with purely a 
semantic approach. Hopefully, if wil! lead to Ideas on how to 
incorporate syntax analysis within its structure to expand its 
power. The system was written in LISP and the description that 


follows uses a model-theoretic notation. 


[t. THE MODEL 


Let C be the set of constant symbols: 
C=L04Py rPo ay Wor Cy 1CosS 0dr2y On} 
| 
where each symbol denotes a set. Let O be the set of objects in the 


data base. Then, 


o=Oul{certain subsets of O}u{O}u{they, them, their,it,its, 


one,ones ,other,others, these, those } 
p,={properties} 
po={eertain subsets of p, tutp,} 
w,={what ,which,who, tell ,print,give} 
wo={many } 
c,={and,&,but,except,nei ther} 
c,=for] 
whsianiaat 
d={general words referring to the data base as a whole} 
e,=fal I} 


e,=tany,some} 


Every member of each of the sets must be distinct and unique 


from all of the others. Given with C is a function 
f :Oxp,+tyes,no, | don't know} 


that relates objects and properties. The set o contains all of the 
names of the objects that are the subject of the data base. If certain 
subsets of objects are naturally thought of as a group, the words 
naming the subsets are added to o. Also in o are words referring to the 
entire set of objects as well as anaphoric words such as "they", "it", ete. 
In general, the words in o serve to establish a topic of discussion. 

The objects are the center of attention and they may be referred to 
explicitly, as a whole, as members of a group, or by anaphora. For 

this discussion, It is not important whether o contains the names of 

the objects or the words representing the names of the objects. We 

will refer to o In both senses and, sometimes, as if it contained the 
objects themselves. 

The properties are divided into two sets since it is more Important 
to know what type of property words are being used in the question. Ps 
contains all of the specific property words and Po contains the words 
denoting subsets of Py plus global property words. The set s contains 
words that, for some reason or another, signal that the question cannot 
be answered. s would contain items like numbers, special characters, 
and words close to the domain of discourse but, for which, no information 
is avallable in the data base. The set d contains words referring to 
the data base as a whole that are independent of the data. 

Let Q be the set of recognizable words in the question and let P 
be a monadic predicate symbol. men is a set of interpretations 
such that: 


P(x)=T <> xnQ4o 
P(x)=F <> xnQ=$ 


That is, P(x) is true if and only if at least one of the words 
in x appears in the question. We are interested in the following 


set of clauses: 
$={~P(s),P(0) ¥P(p, )VP(p5) P(A) ~Plw,) HP (Wy) »~P (04) WPLeD) s~P(cq) WPCCp)} 


and the associated finite semantic tree. For each % an answer a(%) will 
be provided.Figure 1 shows the top of the semantic Tree. The tips are 
labeled T, and figure 2 shows a representative subtree for Th 1<i</7. 
These eee are not complete. Plc, ) and Plc, ) are leff out because 
they have no significance in saints O. pcs only appears in Tp 
shown in figure 43. 

T,? The Ty branch of the semantic tree has P(o)= =P(p,)= P(p.)= =T. This 
means that ees are not only specific objects mentioned in the question, 
but also specific properties and property set words. Thus, 


a( :t, ={xep9nd/F (Fond, p4nQ)=yes,x)=yes] 


Q 
That is, those properties from the subset mentioned in the question 

that apply to the objects mentioned qualified by the specific properties. 
a(Goit;) is a applied to the partial interpretation up to T, and is 
considered to be the same for all ®%% containing ae Although a is | 
+he answer to the question, the actual answer that is printed on the 


user's terminal is determined by The ful | %» i.e. the complete path. 
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Figure 2: The oT subtree 
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Figure 3: The Te subtree 


For example, Thy 


asks, "Are there any...?" Thus, a is the constructed set of answers 


asks, "What are all...2"; Ti asks, "How many...?"3; and 


Tig 


that may or may not be printed. 


ik branch just contain objects and specific 


properties. 


The questions in the i 


09,215 )={xeonQ/F (x,p49Q)=yes} 


Thus, it is a simple question of whether or not specific properties 


apply to specific objects. For example, 


To? What objects have X? - Xepy 
T56' How many X and Y objects are there? X,Yep, | 
Tz? In the tz subtree, specific objects are found in the question 


along with property group names. 


a(Ooit.)={xeponQ/F(onQ,x)=yes} 


For example, 


T3,? What properties in such and such group does that » 
object have? 7 
T3073 Do all objects have properties fn this particular group? 


T,? The T, subtree implies that only objects appear in the question. 
In this case, the object names are simply printed out. Ty questions 


very often arise from anaphoric reference. 
a(G2 7, =ond 


For example, 


Ta5! What are some objects? 


Ty3! What are they? What is it? 
— Ty6? How many of them are there? How many objects are there? 
T49' Is X an object? 


The Ts through Tp questions have no objects in them. Thus, they can only 
refer to information about the properties. This makes them somewhat 
easier to handle but introduces some ambiguities. 
T.: Both a specific property and a property group occur in Q. 
a(G,215)={pep,10/pep nd} 
Most of the branches have no meaning. 
Tt 


59° Is this property a member of this group? 


Te. All of the Te questions are meaningless. The only thing in the 


question that is recognizable is one or more specific property names. 
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where Ky is the constant answer "a property." For example, 


T What is X? Xep, 


63° 


TI: The TJ questions have a little more substance than the Te ones. 
We have the name of at least one property group to give information 


about. 

OCG? tT )=ponQ 
_ For example, 
To, ? What are all of the properties of this group? 
T3763 How many properties of this type are there? 
79: Is X eens of this group? XEDo 


We must be careful about TI: Since the property group name is all that 
is recognizable in Q, the word X (see above example) is unknown. If we 
assume that it is present, the answer should be "no". However, it is 
impossible to tel! the difference between the example question given 
above and: 


t.,: Are there properties? 


79° 
for which we want to answer "yes". Since the former question is more 
specific and more likely to be asked, T49 questions get "no" as an 


answer. 


T1 


Te: In Te questions, no objects, no properties, and no property 
groups occur in Q. (see Figure 3) If it also happened that ~P(d), 
there would nothing recognizable in the question for which an 

answer could be given. Thus the reason for the clause in S. If we 
have P(d), a general question has been asked, and it is enough To 


print out a canned information message. 


A(P_it gd=Ky 


For example, 
What fs in the data base? 


Give me some information. 


Anaphoric reference words are handled in a special way. The set o 
has specific object words as well as anaphoric reference words. In order 


to explain the mechanism, o has to be split up. Let: 


a,={they, them, their,it,its,one,ones,other,others} 
oo {these , those} 


fon 
o'=0 (a, ua.) 


a 


A question Q is called a root question if 
o'nQxo 


Thus, any question that has specific objects or object groups occurring 
in it Is a root question. Such questions establish DcO, the set of 
objects under current consideration. Such a subset D is called the current 


domain of discourse. 
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o'nQ4o > D=a(8,) 


o'nQ=$o > D=d 


| D does not change with subsequent Q's unless (1) a new domain is 


established with a new root question, (2) a question. is asked that does 
not contain any objects at all, or (3) a new domain is established 


Through the use of an an word. If, on subsequent questions, 
a, nd 


we form a sub-domain D'cD which contains the objects of D possibly 


' further qualified. 


Cid (a, nQe¢ A D=o) > a( 8 )="2" 
[2] (a, nQ#¢ A D#o) > D'=a() 
[3] o'nQ=¢o > D'=6 


In [lJ], anaphoric reference was used in a question where no 
previous D had been established. Such a question has no meaning. 


In [2], D'cD is established. Subsequent questions containing a, 


words always refer back to the previous D. D!' will change on each Q. 


Questions containing a, words refer back to the D! domain. 


[4] (a,nQ#o A D=o) > a(G =n?" 
[5] (a,nQ> A D#o A Di #o) > (D=a(89) A ‘D't=¢) 


[6] (anda A D#o A D'=o) > D!=a (4) 
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In [4], as previously in LIJ, an a, word was used with no 
established domain. In [6], D' changes but D does not. In ES \s 
an a, word causes a new domain D to be established. An example 
of a sequence of anaphoric questions is given in the next 
section on the implemented data base. 

| The treatment of "and" and "or" was more difficult. Without 
syntax, it is not possible to tell where the connectives appear 


in the question. This is the reason for the clause: 


~P(c, ) WP (co) 
If no connectives appear, "and" is assumed. The situation is made 
somewhat easier by the fact that if either a single object or a 
single property appear in the question, it is obvious what the connective 
applies to. The only bad case is when multiple objects and properties | 
occur in the question along with Nor, | | 

It has been assumed that negation rules were applied before 

the proper interpretation was determined. Negation is the only place 
where context sensitive rulés are applied. In general, when the word 
"not" appears in the question, the next recognizable object or 
property is negated. Two other types of negation that are handled 


are "except" and "neither". 


except X ~*~ all O and not X 


neither X nor Y ~* not X and not Y 


This works fairly well in most cases. 
The word "all" is recognized only as an indicator that the user 
wishes to see the entire list of answers printed. If "all" is not in the 


question, only 20 of the answers are printed out after which the 
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user Is asked if he wants to see another 20. If the word "some" or 


"any" is used, only a few answers are printed. 
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[1 1. IMPLEMENTATION 


The program that implements the semantic tree is written in LISP. 
The objects are names of computer programs and the properties are 
descriptive words that apply to the programs. Appendix B is a 
complete list of the descriptive words. Included as properties are 
such words as "analysis", "chi-square", "Drobability", Fortran", 
"1BM360", "UNIVAC", etc. There are no subsets of objects and the 
word "program" refers to the whole set. The property groups are 
"language", "computer", and "manufacturer". The words "ynroperty" 


and "keyword" refer to the whole set. The stopper words are 


s={fast,documented,system,systems, redistributable,management, 
modularized,where,topic,topics,documentation,source, 
distributor,example,core,big,subroutine,more,greater,less, 
only,percent,this,+,#5$5%,2515@,55/5%)), (sl, 1,2, "tuldigtts} 


and d={database, data,memory, information, know, knowledge} 


Here are some sample questions from the implemented data base 


for some of the more interesting t's. Recognized words are underlined. 


T, 3) What programs are written in languages other than Fortran? 
Ty 3! What computers do analysis programs run on? | 


94: Print all of the Algol programs. 
t.,: What Fortran programs deal with matrix inversion? 


T,-: How many programs are written in PL/I but not in Algol? 
Are there any UNIVAC programs that are compatible with I|BM? 
Does the Burroughs5500 accept programs not written in Algol? 
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7 ,: What language is EDIT written in? 
Tz 53 Do you know if EDIT runs on any specific computer? 
Lk List all of The programs. 
42° What are some of them? 
Taz? What are they? 
tT,2: What is it? 

; ? 
Tae: How many of them are there’ 
T59° Is Fortran a language? 
TE9: Is 1BM360 among the computers? 
TE9? Is inversion a keyword? 

: : pias 
Te! What is analysis: 
t.,: What are all of the languages? 
To: Give me some computers. 
t..: How many manufacturers are there? 
TI? Are there many computers? 

: ? 

39° ls Cobol a language: 


Te,? What is in the database? 
‘ 2 

Te? What do you know: 

Te4! Give me some information. 


t..: How many things are there in your database? 
82 mary. g : pete es: 
Here are some sequential anaphoric reference examples: 


[1] How many languages are there? 
(no reference; D=4;D'=¢) 

[2] How many programs are written fn PL/I? 
(root;no reference ;D=a(4-54);D'=9) 

[3] How many of them run on the CDC6600? 
(refers to [2]; D=a(4-59);D'=a(%-34)) 


he 


[4] How many of them come from |BM? 
= nt= 
(refers to eae a(G-54)5D aC O44)? 
[5] Which of those deal with probability? 
(refers to [4];D=0(-54);D!=9) 
[6] How many of them use covariance calculation? 
N= Nt= 
(refers to [£5];D a(-54)5D a( O69) 
[7] What are these called? 
N= ntle- 
(refers to [6];D a(-64)5D ) 
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|[V. GENERAL REMARKS 


Actually, | am surprized that so many different types of 

questions could be recognized with so little syntax analysis. 

It is interesting that In playing with the system myself, | 

tend to ask questions in normal English even though | know which 
words are being recognized and which are not. In such a simple 
non-numeric world, complicated questions don't seem to come up. 

In testing the system out on others, | have found that a little 
explanation of what is in the data base goes a long way. Someone 
‘who tries to use it knowing nothing except that it answers” ques~ 
tions about computer programs has great difficulty getting started. 
However, once started, almost every question gets an answer. Although 
it ts general for any non-hierarchical non-numeric data base of 
objects and properties, that is still quite a restricted world. 

| belleve that | have gone just about as far as | can without using 
syntax analysis. | believe, though, that syntax analysis should only 
be used when semantic analysis cannot produce a meaning. | also 
believe that a very good English understanding system can be built 
using the techniques in thts paper as a base. Possible extension 
areas are: 

(1) Allowing numeric data in which operations such as counting, 
comparisons, statistics, and arithmetic operations are allowed. 

(2) Allowing object and property structures. For example, a 
corporate employee data base where employees are in projects which 
are in branches which are in divisions, etc. 

(3) Expanded "and"/"or" capability. 
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(4) Allowing a single word to have more than one meaning. 
The meaning would be found from context. 
_ (5) Allowing ideoms, that is, two or more words which mean a 
single thing when found in a specific order. For example, 
data management system. 
(6) Multiple questions connected with "and" should all be answered. 
(7) Spelling correction. 


(8) Morphology (word endings such as plurals) 


There is no reason why data cannot be entered or changed in the 
current system although it was not implemented. The same technique 


can be used effectively. For example, sentences such as: 


EDIT is written in Algol. 
"Cobol" is a language. 


| The currently implemented data base Is "closed". That is, 
( YoreO) (Y pep, ) f(o,p)#I don't know 


lf the data base were not closed, the entry of new information could 
be handled in the following way. If new data is entered that was not 
there previously, it is given the value specified in the sentence. 
However, if the information in the sentence contradicts data already 
stored, a value of "I don't know" could be given. Thus, the system 


would have to be told something twice in order to become a fact. 
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The data comes from a tape made at the University of Wisconsin 
of computer programs from the social sciences and. associated keywords. 
There are approximately 500 programs and 1100 keywords. The program 
itself uses 85 pages (at 1024 words per page) of core memory. Of that, 
approximately 48 pages comprise the LISP compiler, 30 pages are taken 
up by data, 5 pages by the program, and |2 are left as working space. 
The response time is from 5-8 seconds on the average. This is very 
fast compared to syntax analysis programs but the comparison fs not 
really fair since only simple sentences are handled. A question with 
a lot of negations may take up to 30 seconds since the entire data 
base must be searched. In such cases, a polite message is printed 


when the waiting time exceeds a certain. limit. 
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